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Abstract 

The  Navy’s  need  for  faster,  smaller  computers  has  in¬ 
spired  research  on  the  use  of  more  than  two  levels  of  logic  in 
computer  circuits.  This  paper  focusses  on  work  at  NPS  in 
multiple-valued  logic.  It  discusses  the  development  of  multi¬ 
ple-valued  programmable  logic  arrays  (MVL-PLA),  as  well 
as  computer-aided  design  tools  for  MVL-PLA’s. 

Introduction 

The  effectiveness  of  Navy  systems  is  dependent  on  com¬ 
puters.  Computers  are  used  to  predict  weather,  to  track  re¬ 
sources,  to  guide  missiles,  to  simulate  combat,  and  to  process 
the  words  and  numbers  necessary  for  the  general  conduct  of 
Navy  business.  Their  usefulness  depends  on  computing 
power,  speed,  and  size.  As  with  other  critical  resources,  the 
Navy  cannot  depend  on  the  private  sector  as  the  exclusive 
provider  of  the  technology;  it  must  be  an  active  participant 
This  article  focuses  on  computer  circuits,  and  specifically  on 
multiple-valued  circuits,  whose  use  improves  computing 
power,  speed,  and  size.  We  first  consider  binary  circuits.  Then, 


we  discuss  multiple-valued  circuits.  This  serves  as  introduc¬ 
tion  to  the  main  discussion,  research  at  the  Naval  Postgraduate 
School  on  this  important  subject. 

Disadvantages  of  Binary 

Current  computers  are  binary;  they  use  two  values  of 
logic.  For  convenience,  we  represent  these  as  0  and  1.  But  0 
and  1  are  simply  symbols  for  some  quantity,  such  as  voltage, 
current,  or  charge.  For  example,  in  the  most  widely  used 
circuits,  0  represents  0  volts  and  1  represents  5  volts. 

Binary  is  commonly  used  for  historical  reasons.  Comput¬ 
ers  in  the  1940’s  used  relays,  which  had  two  stable  states,  open 
and  closed.  Tubes  and  transistors  have  two  stable  states,  satu¬ 
ration  (conducting)  and  cutoff  (nonconducting).  There  are  dis¬ 
advantages  to  binary,  however.  One  is  evident  by  the  number  of 
bits  needed  to  represent  a  number.  For  example,  the  decimal 
number  33  corresponds  to  10001  in  binary.  That  is,  while  five 
symbols  are  needed  to  represent  33  in  binary,  only  two  are  needed 
in  decimal.  Unfortunately,  the  difference  increases  with  the  size 
of  the  number.  This  inherent  complexity  is  hidden  from  most 
users  by  hardware  (e.g.,  binary  to  decimal  converters  in  digital 
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watches)  and  by  software  (e.g„  high  level  languages).  How¬ 
ever,  certain  disadvantages  cannot  be  so  simply  hidden.  Real 
penalties  exist  in  both  compactness  and  speed. 

Compactness 

The  complexity  of  the  circuits  that  perform  addition, 
multiplication,  and  other  arithmetic  operations  depends  on  the 
number  of  symbols  used.  For  commonly  used  number  sys¬ 
tems,  this  complexity  increases  with  the  number  of  symbols. 
As  a  result,  so  does  the  chip  area  needed  for  devices.  However, 
the  most  significant  penalty  is  not  with  the  devices,  but  the 
interconnect  between  devices.  In  VLSI  circuits,  about  70%  of 
the  chip  area  is  used  for  interconnect,  20%  for  insulation,  and 
10%  for  devices.  Interconnect  corresponds  to  the  chip  area 
used  to  carry  information  around  the  circuit.  Insulation  is 
needed  to  separate  devices  and  interconnect.  With  so  much 
area  used  to  connect  devices,  less  area  is  available  for  logic. 

The  inefficient  use  of  interconnect  by  binary  also  occurs 
outside  the  chip.  Signals  going  into  and  out  of  a  VLSI  chip 
must  use  pins  connecting  the  chip  to  the  circuit  board.  This  is 
called  the  pinout  problem.  That  is,  while  significant  reductions 
have  occurred  in  the  size  of  logic  devices,  there  has  been  no 
comparable  reduction  in  the  size  of  integrated  circuit  pin 
connections.  Strength  and  reliability  dictate  a  (relatively  large) 
minimum  pin  connection  size.  As  a  result,  there  is  a  need  to 
better  use  existing  pins. 

Speed 

A  limit  on  the  speed  of  arithmetic  circuits  is  the  carry  (or 
borrow)  between  digits.  For  example,  in  binary  addition,  the 
most  significant  sum  bit  depends  not  only  on  the  most  signif¬ 
icant  bits  of  the  two  numbers  being  added,  but  also  on  all  lower 
bits  (contrast  this  to  the  least  significant  sum  bit  which  does 
not  depend  on  higher  order  bits).  The  dependence  occurs 
through  the  carry  between  bits.  Thus,  computation  of  the  most 
significant  sum  bit  must  wait  until  the  carries  out  of  all  lower 
order  bits  are  computed.  Addition,  when  done  in  this  way, 
cannot  be  performed  at  high  speed. 

However,  there  are  multiple- valued  number  systems 
where  this  dependence  does  not  exist  An  example  is  the 
residue  number  system.  In  this  system,  operations  that  form 
the  sum,  difference,  or  product  occur  only  at  each  digit  inde¬ 
pendent  of  all  other  digits.  Because  of  this  independence, 
arithmetic  operations  are  fast  in  the  residue  number  system. 

Multiple-Valued  Logic 

All  of  the  disadvantages  discussed  above  can  be  alleviated 
by  using  more  than  two  levels  of  logic.  The  problem  of  a  large 
number  of  bits  needed  to  represent  a  number  decreases  as  the 
number  of  logic  values  increases.  Interconnect,  both  internal  and 
external  to  the  VLSI  chip,  is  more  efficiently  used  in  multiple- 


Figure  1. 

Photomicrograph  ofaBasic  Charge  Coupled  Device  Program¬ 
mable  Logic  Array  (Courtesy  of  the  University  of  Twente,©IEEE 
1988). 


f  * 

■  ■  Ml 

mmmmtf  im  ■  9  *  > 

ty  «r ; 

M  ag 

^  JB* ®-  > 

j|.  j.* 

4  '*■  *  9  ® 

KU _ ? 

Er  -  m 

M~r  i _  ■ 

3  J®  . 

■fffjjfl't 

*Y’.  !  M 

tmZjJ  J  ,f'T; 

I  9 

MS  M  l 

19  9  9  9  9  9  9  9  9  9 

_ : _ 

valued  logic.  The  carry  propagation  problem  disappears  with 
the  proper  choice  of  multiple-valued  number  system. 

However,  there  remains  the  question  of  implementing  a 
multiple-valued  system.  Modem  computing  devices  naturally 
allow  more  than  two  levels  of  logic.  For  example,  in  charge- 
coupled  devices  (CCD),  logic  levels  are  represented  as  various 
quantities  of  charge2.  Resonant-tunnelling  devices3  allow  four 
or  more  levels  of  voltage.  Fuzzy  logic  devices  offer  large 
numbers  of  logic  levels;  so  many,  that  they  are  modelled  as 
infinite;  present  circuit  implementations  exceed  15  levels1. 
Bio-molecular  devices,  where  information  processing  occurs 
at  the  molecule  level6,  operate  on  an  enormous  number  of  logic 
levels,  conservatively  estimated  to  be  over  10,000. 

Multiple-Valued  Programmable  Logic  Arrays 

The  design  of  logical  circuits  is  a  complex  process.  The 
vast  amount  of  circuitry  needed  for  even  a  simple  operation 
like  addition  can  be  daunting.  Because  of  this,  a  way  is  needed 
to  organize  circuits.  The  programmable  logic  array  or  PL  A  is 
a  circuit  structure  designed  to  handle  this  complexity.  PLA’s 
are  uniform  and  thus  easily  replicated  in  VLSI.  They  can  be 
programmed,  and  therefore  adapted  to  realize  a  given  design 
specification.  Because  of  this  characteristic,  our  research  at  the 
Naval  Postgraduate  School  has  concentrated  on  PLA  design. 

In  a  cooperative  venture  with  the  University  of  Twente  in 
Enschede,  The  Netherlands,  we  have  developed  a  PLA  circuit 
for  charge-coupled  device  (CCD)  technology  (See  Figure  1 
from2).  In  CCD,  values  are  stored  in  cells  (capacitors)  as 
charge.  A  logic  0,  1,  2,  and  3  is  stored  as  0,  1,000,000, 
2,000,000,  and  3,000,000  electrons.  Computation  occurs  as 
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charge  moves  among  cells  combining  and  breaking  up.  An 
advantage  of  CCD  is  compactness,  more  so  than  any  other 
VLSI  technology.  While  slower  than  the  common  CMOS 
technology,  it  is  faster  than  disk  and  stands  as  a  replacement 
for  disk.  The  use  of  multiple- valued  logic  in  CCD  increases 
its  density  significantly.  CCD  is  used  as  a  light  receptor,  and 
the  advent  of  logic  circuits  in  CCD  means  that  image  process¬ 
ing  can  be  done  on  the  same  chip  in  which  the  image  is 
received.  With  large  numbers  of  logic  levels,  there  is  no  need 
for  encoders  between  light  receptors  and  the  logic  used  to 
process  and  store  the  image.  CCD  circuits  with  many  logic 
levels  have  been  fabricated.  For  example,  Hitachi  has  suc¬ 
ceeded  in  building  a  16  level  CCD  memory. 

While  the  uniform  structure  of  a  PLA  helps  one  to  handle 
the  high  complexity  of  logic  circuits,  there  is  the  problem  of 
designing  large  PLA’s.  To  make  multiple-valued  PLA  design 
feasible  for  large  systems,  we  initiated  a  program  to  develop 
computer-aided  design  tools. 

Computer-Aided  Design  for 
Multiple-Valued  Logic 

We  began  this  program  with  a  study  of  heuristic  tech¬ 
niques  for  finding  minimal  PLA’s,  PLA’s  with  the  smallest 
structure.  A  heuristic  will  produce  a  design,  although  not 
necessarily  a  minimal  one.  In  1987  at  the  beginning  of  this 
study,  there  were  three  heuristic  techniques.  At  that  time,  there 
was  no  systematic  analysis  of  their  relative  merits;  each  ex¬ 
isted  separately.  In  an  effort  to  gain  an  understanding  of  the 
multiple-valued  PLA  design  process,  we  compared  the  three 
heuristics  on  the  same  functions  (specifications).  One  interest¬ 
ing  result13  was  that  heuristics  tended  to  perform  better  on 
different  classes  of  functions,  and  there  was  a  surprising 
advantage  to  applying  all  three  and  choosing  the  most  compact 
realization. 

We  also  provided  a  partial  answer  to  an  important  ques¬ 
tion;  How  well  do  heuristics  perform  compared  to  the  best  that 
one  could  possibly  do?  To  answer  this,  we  developed  the  first 
practical  approach  to  finding  provably  minimal  solutions;  an 
efficient  search  technique  that  is  much  faster  than  exhaustive 
search,  but  still  guaranteeing  a  minimal  solution.  Indeed, 
without  the  improved  search  technique,  we  would  have  been 
unable  to  achieve  the  minimal  solution  because  of  the  enor¬ 
mous  computation  time  required  by  exhaustive  search.  This 
comparison  provided  much  needed  insight  into  heuristic  meth¬ 
ods  and  provided  realism  in  our  expectation  of  the  quality  of 
solutions  provided  by  heuristic  methods. 

It  is  important  to  state  that  these  experiments  deal  with 
small  functions;  for  even  medium  size  functions  this  experi¬ 
ment  would  have  been  impossible.  For  larger  functions,  the 
only  approach  is  heuristic.  Indeed,  our  research  shows  that 
often  a  minimal  realization  is  not  produced.  Although  a  de¬ 
signer  will  not  know  how  close  his/her  design  is  to  the  opti- 


Figure  2. 
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mum,  our  study  indicates  that  deviations  are  probably  less  than 
10%  away.  Ours  was  the  first  systematic  study  of  the  problem. 


Our  experience  from  this  analysis  showed  the  need  for  a 
tool  to  analyze  PLA  design  heuristics.  In  1988,  we  launched 
an  extensive  design  project  for  such  a  tool.  The  result  was 
HAMLET  (Heuristic  Analyzer  for  Multiple- Valued  Logic  Ex¬ 
pression  Translation),  the  first  practical  computer-aided 
(CAD)  tool  for  multiple-valued  logic.  HAMLET16  has  the 
ability  to  analyze  heuristics  specified  by  the  user,  using  either 
individual  functions  or  randomly  generated  functions.  This  is 
a  particularly  useful  feature.  Instead  of  writing  a  separate 
program  to  generate  test  inputs,  this  is  done  automatically  in 
HAMLET.  Of  special  significance  is  HAMLET’s  ability  to 
collect  and  automatically  display  heuristics.  Tasks  that  nor¬ 
mally  took  man-days  can  now  be  literally  done  in  keystrokes. 
HAMLET  can  produce  ensembles  of  test  cases  whose  statis¬ 
tical  properties  can  be  controlled.  The  search  algorithm  used 
in  reference  13  was  also  incorporated  into  HAMLET.  We  are 
now  able  to  use  the  search  to  find  solutions  that  were  impossi¬ 
ble  to  obtain  with  any  previous  method.  The  search  can  be 
controlled.  At  one  extreme,  it  can  go  directly  to  a  PLA  realiza¬ 
tion  of  a  given  function.  At  the  other,  it  can  perform  a  complete 
search,  producing  a  known  minimal  solution.  In  effect,  this  is 
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Figure  3. 

PLA  Layout  Produced  by  HAMLET. 
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like  a  dial,  one  end  of  which  corresponds  to  fast  but  poor 
solutions,  while  the  other  end  corresponds  to  slow  but  minimal 
solutions.  HAMLET  can  also  do  design,  producing  the  layout 
of  a  PLA,  given  a  specification.  Figure  3  shows  one  PLA 
layout  produced  by  HAMLET.  HAMLET  is  designed  to  have 
a  long  lifetime.  It  is  easily  modified;  indeed  an  improved 
heuristic  has  been  added14,  as  well  as  an  entirely  new  ap¬ 
proach4  (see  below).  Also,  HAMLET  has  been  used  by  re¬ 
searchers  in  at  least  four  countries. 

Simulated  Annealing 

When  metal  or  glass  is  heated  and  then  slowly  cooled,  it 
is  said  to  undergo  annealing.  The  final  cooled  state  is  similar 
to  a  crystal  and  represents  a  low  energy  state.  If  it  is  cooled  at 
a  high  rate,  atoms  have  less  of  a  chance  to  align  and  a  higher 
energy  state  occurs. 

In  1953,  Metropolis11  proposed  a  method  of  optimizing 
complex  problems  that  mimics  this  process.  It  is  called  simu¬ 
lated  annealing.  We  have  formulated  simulated  annealing  for 
the  PLA  minimization  problem  as  follows.  One  can  satisfy  a 
given  PLA  specification  by  producing  a  set  of  implicants.  Each 
implicant  represents  a  part  of  the  whole  PLA.  Solving  the  PLA 
minimization  problem,  therefore,  is  equivalent  to  finding  the 
fewest  implicants  that  satisfies  the  specification.  Indeed,  there 
is  a  direct  relationship  between  the  number  of  implicants  and 
the  chip  area  occupied.  Thus,  reducing  the  number  of  im¬ 
plicants  by  half,  for  example,  results  in  almost  a  one-half 
reduction  in  chip  area.  Implicants  can  be  manipulated.  For 
example,  one  implicant  can  be  divided  into  two,  pairs  some¬ 
times  can  be  combined  into  a  single  implicant,  and  pairs  can 
sometimes  be  changed  into  another  pair,  or  a  triple,  etc.. 
Ideally,  one  would  like  to  combine  a  pair  of  implicants  into 
one,  since  this  reduces  PLA  chip  area.  However,  in  a  given  set 
of  implicants,  it  is  quite  possible  that  no  pairs  combine.  Such 
a  set  is  said  to  be  a  local  minimum.  However,  by  replacing  a 
pair  by  another  pair,  or  by  a  triple,  etc.,  it  is  possible  to  create 
a  new  set  of  implicants,  where  now  many  combine,  leading  to 
a  smaller  seL  The  descriptor  “local”  means  there  are  no  im¬ 
plicant  sets  nearby  that  contain  fewer  elements.  It  is  not  a 
“global”  minima  if  there  is  another  set  of  implicants  (some¬ 
where)  that  has  fewer  elements. 

The  derivation  of  a  minimal  set  is  a  difficult  problem.  A 
heuristic  generates  a  solution  to  a  problem,  but  not  necessarily 
a  minimal  one.  The  PLA  minimization  problem  belongs  to  the 
set  of  NP-complete  problems,  which  means  that  the  best 
known  algorithm  for  finding  the  minimal  solution  increases 
exponentially  in  complexity  as  the  problem  size  increases.  It 
is  for  this  reason  that  there  is  so  much  interest  in  heuristics. 
Simulated  annealing  has  the  benefit  that,  under  certain  condi¬ 
tions,  a  minimal  solution  will  be  found  with  a  probability  that 
approaches  100%  as  the  process  continues.  This  is  unlike  any 
other  known  heuristic  for  PLA  minimization,  where,  for  cer¬ 


tain  PLA  specifications,  the  probability  of  finding  a  minimal 
solution  is  0%. 

In  effect,  simulated  annealing  is  a  search  through  a  space 
of  solutions.  The  basic  computation  is  a  move.  That  is,  given 
one  solution  to  the  PLA  specification,  another  solution  is 
obtained  by  making  a  move.  Each  move  begins  by  first  select¬ 
ing  a  pair  of  implicants.  If  the  two  implicants  can  be  combined, 
they  are,  completing  the  move.  If  the  implicants  cannot  be 
combined,  a  replacement  is  considered  with  the  fewest  number 
of  equivalent  implicants.  In  effect,  a  weighted  coin  is  tossed. 
If  the  coin  lands  with  heads  up,  the  replacement  is  made, 
completing  the  move.  Otherwise,  it  is  not  made,  and  another 
pair  is  selected.  The  analogy  with  annealing  is  this.  At  each 
temperature,  the  weighting  of  the  coin  is  the  same  for  some 
fixed  number  of  moves.  In  our  programs,  we  allow  20,000 
moves  at  each  temperature.  At  high  temperatures,  the  weight 
is  such  that  heads  almost  always  comes  up,  which  means  that 
all  moves  are  accepted.  However,  at  low  temperatures,  the 
weight  is  shifted  to  tails,  so  that  fewer  moves  are  accepted 
which  increase  the  number  of  implicants.  At  any  temperature, 
a  move  that  reduces  the  number  of  implicants  is  accepted. 
Thus,  at  low  temperatures,  the  mixture  of  generated  moves  is 
predominantly  PLA  complexity-decreasing  moves.  The  exis¬ 
tence  of  complexity-increasing  moves  at  all  temperatures  is 
important;  it  allows  the  system  to  escape  from  local  minima. 
This  is  analogous  to  annealing,  in  which  atoms  at  high  tem¬ 
perature  move  about  freely.  At  lower  temperatures  the  freedom 
is  restricted,  as  they  settle  into  a  low  energy  state. 

Figure  4  shows  how  simulated  annealing  performs  on  a 
multiple-valued  function  that  begins  with  96  implicants.  This 
solution  was  obtained  by  applying  a  heuristic  to  some  given 
PLA  specification.  The  axis  labeled  “number  of  product 
terms”  measures  the  quality  of  the  solution  to  the  PLA  speci¬ 
fication;  the  fewer  the  better.  The  axis  marked  temperature 
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Figure  4. 

Simulated  Annealing  Applied  to  Multiple-Valued  PLA  Minimization. 
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measures  the  probability  with  which  implicant  increasing 
moves  are  accepted.  At  higher  temperatures  (toward  the  front), 
almost  all  implicant-increasing  moves  are  accepted.  The  ver¬ 
tical  axis  represents  the  number  of  times  a  solution  is  found  at 
the  temperature  and  the  number  of  implicants  on  the  x-y  plane. 
Here,  color  encodes  the  vertical  deviation.  In  effect,  the  verti¬ 
cal  axis  shows  how  the  simulated  annealing  program  is  doing 
with  respect  to  the  number  of  product  terms.  Specifically,  at 
the  highest  temperature  (the  slice  closest  to  the  front),  one  can 
see  how  the  simulated  annealing  progresses  from  the  initial 
solution  of  96  implicants  up  to  as  many  as  216  implicants.  This 
is  described  as  melting.  As  the  temperature  decreases  from  this 
point,  there  is  steady  progress  towards  PLA  specifications  with 
fewer  implicants.  In  this  application  of  simulated  annealing,  a 
solution  of  88  implicants  is  achieved.  The  behavior  of  the 
implicants  is  similar  to  the  behavior  of  individual  atoms  as 
metal  or  glass  anneals;  as  the  temperature  decreases,  the  form 


of  the  final  material  takes  shape  as  individual  atoms  occupy  a 
site  in  the  structure  corresponding  to  low  energy. 

A  comparison  of  simulated  annealing  with  other  PLA 
minimization  heuristics  shows  that  it  is  superior  on  an  average 
case  basis.  That  is,  using  HAMLET,  random  functions  were 
generated,  heuristics  were  applied  to  all,  and  the  results  com¬ 
pared.  Simulated  annealing  surpasses  the  all  known  heuristics 
on  the  solutions  obtained.  Although,  more  time  is  needed, 
simulated  annealing  has  the  benefit  that  its  performance  can 
be  controlled.  That  is,  with  larger  computation  times,  one  can 
achieve  a  more  compact  realization. 

Conclusions 

The  Navy  has  a  tradition  of  commitment  to  computing,  as 
epitomized  by  the  contributions  of  Rear  Adm.  Grace  Murray 
Hopper.  Indeed,  in  the  past  50  years,  significant  improvement 
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has  occurred  in  Navy  systems  because  of  the  computer.  It  is 
clear  that  the  next  50  years  will  bring  even  further  improve¬ 
ment  The  promise  of  compact,  high  speed  computers  has 
inspired  our  work  on  multiple- valued  logic. 

Multiple- valued  logic  offers  a  means  to  overcome  signif¬ 
icant  disadvantages  of  binary.  It  makes  more  efficient  use  of 
chip  area  by  encoding  more  information  in  the  wires  that 
connect  devices,  and  it  allows  the  use  of  high-speed  carry-less 
operations.  Our  work  at  the  Naval  Postgraduate  School  has 
been  focused  on  development  of  techniques  (PLA’s)  and  the 
tools  (CAD)  needed  to  make  multiple-valued  logic  a  reality. 

Our  current  effort  focuses  on  expanding  simulated  an¬ 
nealing.  This  includes  a  promising  approach  to  high-speed 
computations;  indeed,  initial  indications  show  a  modification 
of  the  conventional  simulated  annealing  paradigm  can  pro¬ 
duce  computation  speeds  higher  than  any  known  heuristic, 
while  maintaining  almost  the  same  capability  to  minimize  chip 
area.  We  are  also  pursuing  the  use  of  parallel  computers  to 
design  PLA’s15,  including  simulated  annealing. 
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